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Abstract 

The  high-bandwidth  digital  radio  link  between  a 
mobile  robot  and  its  remote  control  station  degrades 
quickly  as  the  robot  penetrates  the  interior  of  a 
building  or  becomes  shielded  by  intervening  terrain. 
This  paper  describes  a  current  project  that  uses 
mobile  autonomous  communication  relay  nodes  to 
overcome  this  problem.  Each  node  is  a  small  slave 
robot  equipped  with  sonar,  ladar,  and  802.1  lb-based 
ad  hoc  networking  radio.  The  relay  robots  follow  the 
lead  robot  and  automatically  stop  where  needed  to 
maintain  a  solid  communication  network  between  the 
lead  robot  and  the  remote  operator.  With  their  on¬ 
board  external  sensors,  they  also  act  as  rearguards 
to  secure  areas  already  explored  by  the  lead  robot. 
As  the  lead  robot  advances  and  RF  shortcuts  are 
detected,  relay  nodes  that  become  unnecessary  will 
catch  up  to  the  lead  robot  and  be  reused,  using  maps 
generated  by  the  lead  robot.  All  relay  deployment 
and  redeployment  functions  occur  without  the 
operator's  awareness. 

1.  Objectives 

One  of  the  weaknesses  of  eurrent  mobile  robots 
operating  in  real-world  seenarios  is  the 
eommunieation  link  to  the  operator’s  eonsole.  Hard 
eables  reduee  mobility  and  often  beeome  entangled 
and  broken,  rendering  the  robot  inoperable.  User 
surveys  have  identified  radio-frequeney  (RF) 
eommunieations  as  more  desirable  [1].  However, 
most  RF  eommunieation  systems  eurrently  employed 
on  teleoperated  robots  in  the  field  are  analog,  whieh 
often  experienee  signal  interferenee,  multipath,  and 
attenuation.  Spread  speetrum  digital  systems  are 
more  immune  to  these  problems  and  provide  a  level 
of  transmission  seeurity,  but  operate  at  shorter  ranges 
and  mostly  on  line-of-sight  (LOS). 

To  extend  the  range  of  these  digital  radios  and 
provide  non- line- of- sight  serviee,  we  are  exploring 
the  use  of  relay  nodes.  These  nodes  eould  be 
dropped  by  the  mobile  robots  where  required. 
However,  in  taetieal  and  reeonnaissanee  missions, 
the  robot's  eonvoluted  path  may  often  lead  to 
situations  where  intermediate  relay  nodes  are  no 
longer  needed  (e.g.,  RF  shorteuts  are  eneountered). 


To  maximize  resourees  and  allow  for  extended 
explorations,  unneeded  relay  nodes  should  be 
reelaimed  and  reused.  We  aeeomplish  this  funetion 
through  the  use  of  mobile  relay  robots  that  follow  the 
lead  robot  in  eonvoy  fashion  (Figure  1),  stop  and  aet 
as  relay  nodes  where  needed,  and  eateh  up  to  the  lead 
robot  to  be  redeployed  when  no  longer  needed. 
These  aetivities  are  all  performed  without  the 
operator's  involvement.  With  minimal  additional 
sensory  hardware,  these  relay  nodes  will  also  aet  as 
rearguards,  preventing  areas  previously  tagged  as 
elear  of  hostile  elements  by  the  lead  robot  from  being 
re-oeeupied  without  deteetion. 


Figure  1.  Four  relay  robots  eonvoying  behind 
the  lead  robot  (laboratory  demonstration 
seenario). 

2.  Approach 

This  project  is  being  eondueted  in  two  phases.  Phase 
1  addresses  the  deployment  of  relay  units  and 
establishing  a  relaying  network.  The  speeifie  steps  to 
be  aeeomplished  in  phase  1  include : 

1.  Developing  a  convoying  strategy  to  allow  four 
mobile  relay  robots  to  follow  a  teleoperated  lead 
robot  into  a  building. 

2.  Developing  a  strategy  for  deploying  the  relay 
nodes  at  appropriate  locations.  Since  there  can 
be  many  RF  nulls  (locations  where  the  RF  signal 
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strength  is  locally  low),  this  most  likely  involves 
a  relay  robot  stopping  only  when  the  signal 
strength  to  the  closest  node  to  the  rear  has 
decreased  beyond  a  set  point  and  further  forward 
movement  fails  to  improve  it. 

In  phase  2,  the  re-deployment  and  rearguard 
functions  are  addressed.  The  ability  of  the  relay 
robots  to  find  and  catch  up  to  the  lead  robot  means 
that  a  map  is  needed.  (Two  robots  can  be  in  RF 
range  of  each  other,  but  far  enough  to  be  outside 
visual  range.  Navigation  by  RF  direction  is  also  very 
difficult  in  a  complex  environment.)  Thus  the 
specific  steps  of  phase  2  are: 

1.  Acquiring  a  real-time  mapping  ability  for  the 
lead  robot.  The  lead  robot  will  map  the 
environment  as  it  passes  through  it. 

2.  Adding  the  ability  for  the  lead  robot  to  pass  the 
map  back  to  a  relay  node  that  needs  it. 

3.  Developing  the  navigational  skill  to  allow  a 
relay  robot  to  catch  up  to  the  lead  robot  to  be 
reused. 

4.  Adding  rearguard  functions  (detection  of 
intruders)  to  deployed  relay  nodes. 

We  are  leveraging  our  existing  pool  of  laboratory 
robots  for  this  demonstration,  using  ROB  ART  III  as 
the  lead  robot  and  four  ActivMedia  Pioneer  l-DX's 
as  the  relay  robots  (Figure  1).  Details  on  these  robots 
and  their  configurations  were  given  in  our  previous 
paper  [2].  A  transition  to  the  real  world  will  probably 
require  more  rugged  tracked  robots  that  can  handle 
unpredictable  terrain. 

3.  System  Development 

ROB  ART  III,  developed  in-house,  is  an  advanced 
technology-base  development  and  demonstration 
platform  for  physical  security  and  non-lethal  tactical 
response.  To  prepare  ROBART  III  for  use  in  this 
project,  a  SICK  LMS200  2-D  laser  radar  (ladar)  has 
been  added  to  support  the  real-time  mapping 
function.  A  KVH  fiber-optic  gyro  has  also  been 
incorporated  for  improved  dead-reckoning  accuracy. 
The  master  onboard  processor  has  been  upgraded 
from  a  68HC 11 -based  microcontroller  to  a  more 
powerful  Bright  Star  Engineering  (BSE)  ipEngine. 
The  credit-card- sized  ipEngine  hosts  a  66  MIPS 
PowerPC  CPU,  4  MB  of  flash  memory,  16  MB  of 
RAM,  16,000-gate  FPGA,  and  dual  RS-232  and 
lOBase-T  Ethernet  ports.  The  FPGA  can  be 
configured  to  provide  additional  input/output  ports 
for  various  sensors. 

For  use  as  the  relay/rearguard  nodes,  we  equipped 
four  Pioneer  2-DX  robots  with  a  suite  of  navigation 
and  security  sensors,  processors,  and  RF  modems.  A 
SICK  LMS200  ladar  was  added  to  allow  the  robots  to 


perform  the  convoying  function.  A  magnetic 
compass  facilitates  orientation  for  navigation  using 
global  maps.  To  provide  rearguard  functions,  we 
installed  on  each  Pioneer  a  Sony  pan-tilt-zoom 
camera  and  a  microphone  (Figure  2).  These  will  be 
used  in  conjunction  with  the  onboard  sonars  and 
ladar  for  intrusion  detection  in  areas  that  the  lead 
robot  has  passed  through  and  are  supposed  to  be 
clear  of  hostile  elements. 


Figure  2.  A  Pioneer  robot  configured  for 
communications  relay  and  rearguard  functions. 


To  provide  more  processing  power,  we  replaced  the 
two  BSE  ipEngine  boards  mentioned  in  our  previous 
paper  [2]  with  a  BSE  nanoEngine,  an  even  smaller 
processor  card  with  a  200  MHz  Strong  ARM  SAl  1 10 
microprocessor.  We  built  a  nanoEngine  daughter¬ 
board  (Figure  3)  to  provide  power  regulation  and 
various  I/O  interfaces  to  the  nanoEngine,  including 
lOBase-T  Ethernet,  USB,  general-purpose  10,  ECD, 
and  five  RS-232  ports  (two  of  which  are  provided  by 
a  DU  ART  on  the  daughterboard).  Devices  that  will 
make  use  of  these  serial  ports  include:  the  Pioneer 
microcontroller,  the  SICK  ladar,  the  Sony  camera 
control  lines,  the  electronic  compass,  and  the  voice 
synthesizer. 

Video  and  audio  processing  is  handled  by  the  Indigo 
Vision  VP 604  board.  The  VP 604  resulted  from  a 
contract  from  SSC  San  Diego's  Man-Portable 
Robotic  System  project  [3,4]  to  Indigo  Vision,  to 
combine  the  functions  of  their  existing  VP 5 00  video 
digitizer/encoder  and  VP 4 00  decoder  into  a  miniature 
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hardware  codec  (4.14"  x  2.14"  in  size).  The  VP604 
supports  four  input  analog  video  channels  and  one 
output  video  channel  in  S -video,  RGB,  or  composite 
(CVBS)  format,  plus  analog  audio  input/output,  and 
communicates  over  a  standard  10/100  Base  Ethernet 
network.  A  daughterboard  for  the  VP604  was 
similarly  developed  that  provides  regulated  power, 
access  to  all  ports,  a  microphone  differential 
preamplifier  with  Automatic  Gain  Control  (AGC), 
and  a  675mW  audio  amplifier  with  manual  volume 
control  for  the  output  audio  channel.  Indigo  Vision 
is  working  on  advanced  motion  detection  functions 
for  the  VP 604  under  a  separate  contract  from  SSC 
San  Diego. 


Figure  3.  A  nanoEngine  and  its  daughterboard. 


4.  Compact  Ad  Hoc  Networking  Radios 

There  are  several  problems  with  currently  available 
IEEE  802.11 -type  wireless  modems  that  make  them 
difficult  to  use  in  a  mobile-robot-based  network. 
Most  are  either  rather  large  or  require  two  units 
(access  point  and  bridge)  to  operate  in  relay  mode. 
They  are  also  inefficient  in  network  reorganization  in 
the  presence  of  node  mobility.  To  solve  these 
problems,  we  have  worked  with  BBN  Technologies 
to  implement  a  new  ad  hoc  networking  solution 
developed  by  BBN  under  DARPA/IPTO’s  Software 
for  Distributed  Robotics  (SDR)  program. 

BBN’s  ad  hoc  networking  software  uses  a  proactive 
link-state  protocol.  Each  node  in  the  network  has 
complete  information  about  the  characteristics  of  all 
links.  It  can  execute  a  routing  algorithm  of  its  choice 
and  determine  the  paths  most  suitable  for  the  chosen 
criteria.  Each  node  uses  broadcast  messages  (sent  at 
intervals  determined  by  the  network  criteria  and  the 
environment)  to  determine  the  characteristics  of  the 
links  and  set  up  the  routing  table.  The  routing  table 
is  recomputed  whenever  certain  network  events 
occur,  such  as  when  the  link  quality  between  two 


nodes  has  dropped  below  a  preset  level  appropriate 
for  a  desired  scenario.  Thus  the  routing  table  can  be 
updated  before  a  link  is  broken,  and  the  network  is 
automatically  maintained  in  a  proactive  fashion,  for 
optimal  information  transmission  and  minimal  lag. 
There  is  no  delay  incurred  for  route  re- selection  due 
to  broken  links. 

This  software  has  been  incorporated  into  a  set  of 
compact  ad  hoc  networking  wireless  modems,  each 
the  size  of  a  pack  of  playing  cards  (Figures  4  and  5). 
Each  stand-alone  wireless  modem  contains  an 
802.11b  wireless  EAN  card  (the  ORINOCO 
WaveLAN  PC  Card  Gold),  a  nanoEngine,  and  a 
Radio  Interconnect  Board  (RIB)  developed  by  us.  It 
also  has  connectors  for  external  power  and  antenna, 
as  well  as  Ethernet  and  serial  communication  ports. 


Figure  4.  Top  side  of  the  Compact  Ad  Hoc 
Networking  Radio,  showing  the  Wavelan  PC 
Card. 


Figure  5.  Bottom  side  of  the  Compact  Ad  Hoc 
Networking  Radio,  showing  the  nanoEngine 
processor  card. 
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5.  Relay  Deployment  Strategies 

There  are  several  strategies  for  deploying  mobile 
relay  nodes  for  LOS  eonneetivity  [5].  Sinee  our 
eommunieations  links  are  mostly  LOS,  we 
eonsidered  similar  strategies,  but  using  link  quality  to 
determine  eonneetivity.  These  strategies  inelude: 

(1)  The  lead  robot  proeeeds  alone,  with  all  relay 
nodes  remaining  at  the  base  station.  It  then  stops  and 
ealls  for  a  relay  node  when  its  link  to  the  base  station 
is  about  to  break.  A  relay  node  will  move  to  the 
loeation  of  the  lead  robot,  freeing  it  to  advanee 
further.  When  the  lead  robot  finds  its  link  to  the 
relay  node  about  to  break,  it  again  pauses  and  ealls 
for  a  seeond  relay  node  to  take  the  plaee  of  the  first 
relay  node,  allowing  it  to  proeeed  towards  the  lead 
robot  and  repeat  the  proeess. 

(2)  All  relay  nodes  follow  the  lead  robot  in 
eonvoying  fashion.  When  the  link  between  the  base 
station  and  the  last  relay  node  in  the  eonvoy  is  about 
to  break,  that  node  stops  while  the  rest  of  the  eonvoy 
eontinues  on.  Then  when  the  link  between  the  now 
stationary  relay  node  and  the  last  node  in  the 
remaining  eonvoy  is  about  to  break,  that  node  also 
stops  and  beeomes  a  stationary  relay  node.  The 
proeess  eontinues  until  all  nodes  have  been  deployed. 

(3)  Hybrid  strategies  that  fall  in  between  the 
above  two  extremes,  for  example,  allowing  the  lead 
robot  to  move  while  a  relay  node  is  en  route,  or 
pulling  a  small  number  of  relay  nodes  using 
predietive  heuristies. 

Of  these  ehoiees,  strategy  (1)  results  in  the  least 
energy  expenditure  by  the  entire  system.  Eaeh  relay 
node  only  has  to  move  the  minimum  distanee 
required.  It  also  results  in  the  most  delays  for  the 
lead  robot.  The  system  uses  more  energy  in  strategy 


(2)  sinee  the  relay  robots  have  to  follow  the  lead 
robot  on  its  meandering  exploratory  paths.  However, 
the  lead  robot  does  not  suffer  any  delay  due  to  relay 
deployment.  The  hybrid  strategies  in  (3)  ean  be 
developed  as  eompromises,  redueing  the  delays  at 
the  eost  of  a  little  more  energy  eonsumption. 
However,  sinee  our  objeetive  is  eomplete 
transpareney  of  the  relaying  funetion,  any  delay 
imposed  on  the  lead  robot  is  unaeeeptable.  Thus  we 
ehose  to  implement  strategy  (2),  as  illustrated  in 
Figure  6.  As  the  relay  nodes  are  dropped  off  from 
the  end  of  the  eonvoy,  the  lead  robot's  advanee  is  not 
impaeted,  and  the  operator  ean  be  assured  of  a 
reliable  eommunieations  link  without  any  additional 
distraetion  or  burden. 

6.  Algorithm  Development 

We  are  eurrently  writing  software  for  the  relay  robots 
using  a  set  of  tools  developed  by  the  Roboties 
Laboratory  at  the  University  of  Southern  California, 
namely  the  Stage  simulator  and  the  Player  robot 
deviee  server.  Player  eomprises  a  set  of  soeket- 
based  deviee  drivers  that  provide  simple  Unix-file¬ 
like  read/write  aeeess  to  individual  deviees  on  the 
robots  [6,7].  Most  deviees  assoeiated  with  the 
Pioneer  2-DX  have  been  modeled.  Stage  (eurrently 
maintained  by  HRL  Laboratories)  is  a  graphieal  user 
interfaee  and  simulator  for  the  robot  deviees  and 
environment  [7].  It  loads  a  binary  image  file  for  use 
as  a  map  of  the  environment,  spawns  simulated 
Player  deviees  as  speeified  in  a  eonfiguration  file, 
and  runs  external  high-level  programs  that  eontrol 
the  robots’  behaviors.  Figure  7  is  a  partial  sereen 
shot  of  Stage  running  the  eonvoying  program  using 
retrorefleetive  beaeons  (diseussed  below).  High- 
level  software  developed  on  Stage  is  transferable 
with  few  modifieations  to  the  robots,  where  real 
Player  deviees  replaee  the  simulated  instanees. 


Figure  6.  A  demonstration  of  the  eonvoying  strategy  (from  a  simulation  developed  by  the 
University  of  Massaehusetts,  Amherst,  that  establishes  LOS  links  between  mobile  robots  [5]). 
Robot  0  is  the  leader,  who  is  trying  to  reaeh  the  goal  (blaek  square).  Robot  4  is  the  base 
station.  The  others  aet  as  relay  nodes. 
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8.  Real-time  Mapping 


Figure  7.  The  convoying  algorithm  running  on 
Stage.  The  lead  robot  is  moving  randomly.  The  dark 
lines  from  the  robots  outline  areas  visible  to  each 
ladar.  Lighter  lines  represent  sonar  pings. 


7.  Laser  Retroreflective  Beacons 

Our  convoying  algorithm  (a  copy  of  which  runs  on 
each  relay  robot)  uses  the  Pioneer's  SICK  ladar  for 
identifying  and  following  the  robot  ahead,  and  both 
ladar  and  sonars  for  obstacle  avoidance.  The  sonars 
and  ladar  complement  each  other  and  provide  robust 
obstacle  detection.  For  beacon  identification  and 
following,  we  use  the  Player  retroreflective  laser 
barcode  device,  normally  used  for  locating  fixed 
retroreflective  tags  mounted  on  walls.  We 
configured  this  device  for  smaller  tags  that  can  be 
mounted  on  the  back  of  each  robot  (see  Figure  8). 
The  tags  were  constructed  using  1”  strips  of  3M 
Scotchlite  retroreflective  tape,  arranged  in  5 -bit 
binary  patterns.  The  Player  laser  barcode  device 
requires  the  first  and  last  bits  to  be  I's  (reflective), 
resulting  in  eight  possible  IDs  (17  through  31,  in 
increments  of  2).  Under  this  configuration,  the 
beacons  are  detectable  to  4  m  and  identifiable  to  2  m. 

We  first  developed  and  tested  the  convoying 
algorithm  on  the  Stage  simulator  (Figure  7),  then 
transferred  it  to  the  nanoEngines  running  embedded 
Linux  on  the  Pioneer  robots,  where  it  was  fine-tuned 
and  demonstrated  in  the  real  world. 


A  capability  for  real-time  mapping  is  required  for  the 
second  phase  of  our  project,  to  fulfill  both  the 
exploratory  function  of  the  tactical  robot  and  to  guide 
unneeded  relay  robots  to  rejoin  the  convoy. 
Odometry  noise  has  always  been  a  problem  for  real¬ 
time  mapping  of  an  unknown  environment.  It 
introduces  uncertainty  in  the  robot's  position  relative 
to  its  own  map,  especially  when  the  robot  has 
completed  a  circuit  and  come  back  to  a  previous 
point  in  the  environment.  This  problem  is  known  as 
simultaneous  localization  and  mapping  (SLAM). 
Historically,  there  have  been  several  approaches 
developed  to  solve  this  problem,  but  none  was 
completely  successful.  They  required  either  unique 
environmental  features  that  can  be  used  by  the  robot 
for  registration,  or  multiple  passes  through  the  data 
set,  which  is  not  a  good  fit  for  real-time  systems. 
However,  recently  two  similar  techniques  have 
emerged  that  have  the  potential  to  deliver  robust 
SLAM  in  real-time  [8,9].  We  are  considering  using 
the  CMU  algorithm  [8],  distributed  as  part  of  the 
CARMEN  open-source  software  package  [10].  This 
algorithm  combines  an  incremental  maximum 
likelihood  estimator  with  a  posterior  pose  estimator 
to  incorporate  new  ladar  data  into  a  map  and  to 
maintain  consistency  with  older  data,  closing  cycles 
in  the  map. 


Figure  8.  A  relay  robot  with  a  retroreflective  beacon 
on  the  back.  This  unit’s  beacon  ID  is  21  (IOIOI2). 


39 


9.  Conclusions  and  Future  Work 

We  are  demonstrating  a  method  for  automatie 
maintenanee  of  a  high-bandwidth  digital 
eommunieations  link  between  an  advaneing  taetieal 
robot  and  a  base  station.  Our  demonstration  uses 
only  indoor  robots,  although  it  may  have  just  as 
easily  used  traeked  robots  in  outdoor  environments. 
In  faet,  SSC-San  Diego’s  Man  Portable  Robotie 
System  projeet,  whieh  has  fielded  ruggedized 
outdoor  robots  for  use  in  military  and  reseue 
seenarios  [3,4],  has  expressed  interests  in  adapting 
our  teehnology  for  use  in  the  field. 

The  mobility  of  the  relay  nodes  allows  the  network 
eonfiguration  to  be  more  flexible.  It  ean  ehange  in 
real  time  and  adapt  to  the  needs  of  the  advaneing 
taetieal  robot,  moving  relay  nodes  into  new  loeations 
as  needed.  However,  the  luxury  of  having  a  group  of 
eooperative  robots  may  not  be  available  to  most 
users  of  taetieal  robots  in  the  near  future.  Therefore 
we  are  exploring  an  adaptation  of  this  projeet  for  use 
with  just  one  robot. 

In  this  seenario,  a  deployer  module  is  designed  to 
hold  a  number  of  relay  “brieks”  (eaeh  the  size  of  our 
eompaet  ad  hoe  networking  radio,  with  additional 
batteries).  The  deployer  unit  is  either  attaehed  to  the 
taetieal  robot’s  ehassis,  or  is  a  separate,  towed 
module.  Instead  of  using  a  distributed  relay- 
deployment  algorithm,  eontrol  is  eentralized  in  the 
deployer,  whieh  automatieally  launehes  a  relay  node 
where  needed  to  maintain  the  eommunieations  link. 

The  small  size  of  these  statie  relay  nodes  (dietated  by 
the  size  of  the  deployer  unit  and  the  number  of  nodes 
it  has  to  earry)  limits  the  eapaeity  of  the  energy 
souree  that  ean  be  paekaged  in  eaeh  node.  To 
maximize  the  operational  time  of  the  network,  we  are 
also  looking  at  ineorporating  BBN  Teehnologies’ 
energy- eonserving  network  protoeols  [11,12], 
developed  under  a  eontraet  from  DARPA  IPTO’s 
SDR  program.  There  are  several  taeties  that  ean  be 
employed  to  eonserve  energy  in  an  ad  hoe  network, 
ineluding:  (1)  appropriate  use  of  sleep  periods  for 
eaeh  node,  and  (2)  limiting  transmit  power  to  the 
minimum  level  neeessary  to  permit  eommunieation 
between  any  two  nodes.  A  system  with  these 
eapabilities  will  signifieantly  enhanee  the  eapabilities 
of  existing  taetieal  robots. 
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